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Abstract 

Distributed signal processing algorithms have become a hot topic during the 
past years. One class of algorithms that have received special attention are 
particles filters (PFs). However, most distributed PFs involve various heuris¬ 
tic or simplifying approximations and, as a consequence, classical convergence 
theorems for standard PFs do not hold for their distributed counterparts. In 
this paper, we analyze a distributed PF based on the non-proportional weight- 
allocation scheme of Bolic et al (2005) and prove rigorously that, under certain 
stability assumptions, its asymptotic convergence is guaranteed uniformly over 
time, in such a way that approximation errors can be kept bounded with a fixed 
computational budget. To illustrate the theoretical findings, we carry out com¬ 
puter simulations for a target tracking problem. The numerical results show 
that the distributed PF has a negligible performance loss (compared to a cen¬ 
tralized filter) for this problem and enable us to empirically validate the key 
assumptions of the analysis. 


1. Introduction 

Distributed signal processing algorithms have become a hot topic during 
the past years, propelled by fast technological developments in the fields of 
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parallel computing, on one hand, and wireless sensor networks (WSNs), on 
the other. In parallel computing, algorithms are optimized to run fast on a 
set of concurrent processors (e.g., in a graphics processing unit (GPU) |M|1. 
while signal processing methods for WSNs are designed for their implementation 
over a collection of low-power nodes that communicate wirelessly and share the 
processing tasks [36]. Popular techniques in the WSN arena include consensus- 
based estimators [H nil [25], diffusion-based adaptive algorithms isniisiiT] and 
distributed stochastic filters, including Kalman filters I3H1I3Z] and particle filters 
(PFs) |24j|28l dni [16]. While consensus and diffusion algorithms require many 
iterations of message passing for convergence, PFs are a priori better suited for 
online estimation and prediction tasks. Unfortunately, most distributed PFs 
(DPFs) rely on simplifying approximations and their convergence cannot be 
guaranteed by the classical theorems in |9l[l3l[3]. One exception is the Markov 
chain distributed particle filter (MCDPF), for which analytical results exist 
|2H]- However, the MCDPF converges asymptotically as sets of samples and 
weights are retransmitted repeatedly over the network according to a random 
scheme. From this point of view, it is as communication-intensive as consensus 
algorithms and, therefore, less appropriate for online processing compared to 
classical PFs. 

The implementation of PFs on parallel computing systems has received con¬ 
siderable attention since these methods were originally proposed in [T2]. The 
efficient implementation of PFs on parallel devices such as GPUs and multi¬ 
core CPUs is not as straightforward as it seems a priori because these Monte 
Carlo algorithms involve a resampling step which is inherently hard to paral¬ 
lelize. This issue is directly addressed in |S], where two parallel implementations 
of the resampling step are proposed. While the approach of [5] is sound, the 
authors focus on implementation issues and no proof of convergence of the re¬ 
sulting PFs is provided. Only very recently, a number of authors have proposed 
distributed particle filtering schemes with provable convergence dUHO]. These 
methods have a fairly broad scope (the methodology in [IT] can actually be seen 
as a generalization of the techniques in 0 ) yet they appear to be less suitable 
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for practical implementations under communications or computing power con¬ 
straints, as they involve considerable parallelization overhead |40j or depend on 
the centralized computation of certain statistics that involve the whole set of 
particles in the filter mi- 

The goal of this paper is to provide a rigorous proof of convergence for a 
DPF that relies on the distributed resampling with non-proportional weight- 
allocation scheme of [S] (later adapted for implementation over WSNs in [5S]1. 
Under assumptions regarding the stability of the state-space model underlying 
the PF, we prove that this algorithm converges asymptotically (as the number 
of particles generated by the filter increases) and uniformly over time. Time- 
uniform convergence implies that the estimation errors stay bounded without 
having to increase the computational effort of the filter over time. We pro¬ 
vide explicit convergence rates for the DPF and discuss the implications of this 
result and the assumptions on which the analysis is based. The theoretical inves¬ 
tigation is complemented by computer simulations of an indoor target tracking 
problem. For this specific system, we first show that the performance of the 
centralized and distributed PFs is very similar and then proceed to validate 
numerically a key assumption used in the analysis, related to the degree of co¬ 
operation among processing elements in the distributed computing system on 
which the algorithm is run. 

The rest of the paper is organized as follows. In Section we describe the 
DPF of interest. In Section we prove a uniform convergence result for this 
filter and discuss the implications of such result. Computer simulations are 
presented in Section and, finally. Section is devoted to the conclusions. 

2. A distributed particle filtering algorithm 

2.1. State space systems and the standard particle filter 

The stochastic Hltering problem consists in tracking the posterior probability 
distribution of the state variables of a random dynamic system. Often, the prob¬ 
lem is restricted to the (broad) class of Markov state space systems with condi- 
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tionally independent observations. Let {Xn}n>o denote the discrete-time ran¬ 
dom sequence of the system state variables, taking values on the (ia;-dimensional 
set A" C and let {F„}„>i denote the corresponding sequence of observa¬ 
tions, taking values on . The systems of interest are modeled by triplets of 
the form {ro(da;), r„(dx|a;„_i), gniyn\xn)}n>i^ where tq is the prior prob¬ 

ability measure associated to the random variable (r.v.) Xq, Tn{dx\xn-i) is a 
Markov kernel that determines the probability distribution of X^ conditional 
on Xn-i = Xn-i, and gniyn\xn) is the conditional probability density function 
(pdf) of the random observation y„, given the state = Xn, with respect to 
(w.r.t.) the Lebesgue measure. The latter is most often used as the likelihood 
of Xn = Xn given the observation ¥„ = yn- We write gn as a function of Xn 
explicitly, namely g'^’'{xn) — gn{yn\xn), to emphasize this fact. 

The goal in the stochastic filtering problem is to sequentially compute the 
posterior probability measures of given the observations Yi-n = yi-.n, denoted 
TTnidx), for n = 0,1,... (note that ttq = tq). Except for a few particular cases, 
e.g., the Kalman [IS [2] and Benes [3] filters, 7r„ cannot be computed exactly and 
numerical approximations are pursued instead. PFs are recursive Monte Carlo 
algorithms that generate random discrete approximations of the probability 
measures {7r„;n > 1} [H|T31[S]. At time n a typical particle filtering algorithm 
produces a set of X random samples (often termed particles) and associated 
importance weights, r2„ = {xn\wn'^*}fLi with Wn = approx¬ 

imate TTn by way of the random probability measure ir^ = ^ 
where Sx denotes the Dirac (unit) delta measure located at x. 

It is common to analyze the convergence of PFs in terms of the approxima¬ 
tion of integrals w.r.t. 7r„ [TH IH |31 [131133] ■ To be specific, let / : A —>• M be a 
real function integrable w.r.t. 7r„. Then we denote 



and approximate the latter integral (generally intractable) as 
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2.2. A distributed particle filter 

We describe a PF based on the distributed resampling with non-proportional 
allocation (DRNA) scheme of 0 Section IV.A.3] (see also [32I31[33). Assume 
that the set of weighted particles f2„ = {xn\wn^*}^i can be split into M 
disjoint sets, 

such that 

each of them assigned to an independent processing element (PE). The total 
number of particles is N = MK, where M is the number of PEs and K is the 
number of particles per PE. At the m-th PE, m = 1,..., M, we additionally keep 
track of the aggregated weight for that PE. 

Every no time steps, the PEs exchange subsets of particles and weights by 
using some communication network [^. We formally represent this transfer of 
data among PEs by means of a deterministic one-to-one map 

fi : {1,...,M} X {l,...,i^} ^ {!,...,M} X 

that keeps the number of particles per PE, K, invariant. To be specific, (u, v) = 
f3{m, k) means that the fc-th particle of the m-th PE is transmitted to the u-th 
PE, where it becomes particle number v. Typically, only subsets of particles are 
transmitted from one PE to a different one, hence P{m,k) = {m,k) for many 
values of k and m. The DPF of interest in this paper can be outlined as follows. 

Algorithm 1. DPF based on the DRNA scheme of Section IV.A.3], with 
M PEs, K particles per PE and periodic particle exchanges every no time steps. 

1. Form = (concurrently) draw ^ To{dx), k = 1,...,K, and 

set and = 1/M. 

2. Assume that and are available for each m = 

1,...,M. 
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(a) Form = l,...,M (concurrently) and k = 1,K, 

draw ~ Tnidx\x^^f'’), 

compute 

K 

andW^^> = 

k^l 

(b) Local resampling: for m = 1,..., M (concurrently) set x^’^^ = 
with probability 

for k = 1 ,..., K and j G {1,..., K}. 

Set jK for each m and all k. 

(c) Particle exchange: If n = rno for some r € N, then set 

for every (to, k) G {1,..., M}x{l,..., K}. Also set wiT'^* = 
for every to = 1,..., M. 

^,7 . .p , , (m.k) -~{m,k) (m.k)*- ~(m,k)* 

Utkerwtse, %j n ^ rno, set Xn = Xn , Wn = Wn , 

w!r^* = 

Every PE operates independently of all others except for the particle ex¬ 
change, step 2.c), which is performed every uq time steps. The degree of interac¬ 
tion can be controlled by designing the map /3 (to, k) in a proper way. Typically, 
exchanging a subset of particles with “neighbor” PEs is sufficient, as illustrated 
by the following example. 

Example 1. Consider a circular arrangement in which the m-th PE exchanges 
particles with PE {m—1) mod M and (m + l) mod M, where mod indicates 
the modulus operation (a mod b is the integer remainder of the division a/b). 
To be explicit, 

• for each to = 2, ...,M — 1, the m-th PE exchanges particles with two 
neighbours, namely PE number (to — 1) and PE number (to -1-1), 
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• PE number 1 exchanges particles with PE number M and PE number 2, 
and 


• PE number M exchanges particles with PE number M—1 and PE number 

1 . 

Next, assume for simplicity that each PE sends one particle to each one of 
its neighbors (i.e., it sends out two particles) and receives one particle from each 
one of its neighbors as well (i.e., it gets two new particles) so that the number 
of particles per PE, K remains constant. One choice of map (3 that implements 
such an exchange is the following 

{ {m, k) 

(m—1 mod M, K) 

(m + 1 mod M, 1) 

In other words, for each PE m = 1, M, 

• all particles with index k = 2,..., K — 1 remain the same, 

• the first particle (k = 1) is sent to PE m—1 mod M and, in ex¬ 
change, the K-th particle from that neighbor is received, i.e., = 

~(m—1 mod M,K) j (m.l)* ~(m—1 mod M.K)* 

Xn and Wn = Wn , 

• the last particle (k = K) is sent to PEm-\-l mod M and, in exchange, the 
1-st particle from that neighbor is received, i.e., = x^^^ 

7 (m.K)* ~(m+l mod M.l)* 

and Wn = Wn 

It is apparent that this instance of (3 preserves the number of particles per 
PE K constant. More elaborate schemes can be designed and in general this 
is related to the structure of the communication network that interconnects the 
PEs. As long as it is guaranteed that the number of particles that a PE gives to 
its neighbors is the same as the number of particles that it receives from these 
neighbors, the number K of particles per PE remains invariant. 

Remark 1. The local resampling step 2.b) is carried out independently, and 
concurrently, at each PE and it does not change the aggregate weights, i.e.. 


if2<k<K-l, 

ifk=l, 

if k = K. 
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We assume a multinomial resampling 
procedure, but other schemes (see, e.g., w can be easily incorporated. 


2.3. Measure and integral approximations 


Let 

- (m.k)* 


W. 


J2i=iwh 

be the locally normalized versions of the importance weights and let 


w. 


(m,fc) ^ Wn ^ Wn 


■\K 


K 


= 


W, 


(m)* 


eZi wZ* 


and Vbi™) = 


W, 


(m) 


EZi^r 

be the globally normalized aggregated weights of the m-th PE before and after 
the particle exchange step, respectively. The DPF produces three different local 
approximations of the posterior measure 7r„ at each PE, namely 

K ^ K K 

K 


-m,K 




corresponding to steps 2.a), 2.b) and 2.c) of Algorithm The normalized ag¬ 
gregate weights can be used to combine the local approximations, which readily 
yields global approximations of the posterior measure, i.e., 


M 


M 


M 


-MiC 




~MK 

TT ’ IT 

n n ’ n 




);;Lm,K 

) jr > 

n n 


MK 




m) „m,K 

•' TT ’ 


( 1 ) 

Note that only the local normalization of the weights k = \,...,K, is 

necessary for Algorithm[^to run (as they are needed in the local resampling step 
2.b). The computation of the the or are only necessary 

when local or global estimates of 7r„ are needed. However, the computation of 
these estimates can be carried out concurrently with Algorithmjl] i.e., the DPF 
can keep running in parallel with the computation of any estimates. 


Remark 2. Algorithm^^ enjoys some relatively straightforward properties that 
should be highlighted, as they are relevant for the analysis in Section 







1. The particle exchange step does not change the particles or their weights. 

It only “shuffles” the particles among the PEs and updates the aggregate 
weights accordingly. As a result, , since the individual parti¬ 

cles and weights are not changed. 

2. A random exchange (i.e., a random 13) is also possible, although it makes 
certain practical implementations harder m- We abide by a deterministic 
map P for the sake of conciseness, although the analysis can be extended 
to account for random schemes in a relatively straightforward manner. 

3. The ensemble of local resampling steps keeps the local and aggregate im¬ 
portance weights proper and is globally unbiased \S0) . 

The goal of this paper is to analyze the approximation of integrals using the 
random measure in Q. We look into the Lp norm of the approximation 

errors, namely || (/, — (/, 7r„) ||p for p > 1, where / : A’ —?> M is an integrable 

real function on X and || • ||p = E[\ ■ |^]p. The expectation is taken w.r.t. the 
distribution of the r.v. 


3. Analysis 

3.1. Assumptions, preliminary results and notations 

Let 'P(A’) be the set of probability measures on {B{X),X), where B{X) is 
the Borel cr-algebra of open subsets of the state space X. Choose a measure 
a G V{X) and let h : A —> R be a real function integrable w.r.t. a. We define 
the measure-valued map : V{X) —>• V{X) as 


{h, 4'„(a)) = 


{{hgl”,Tn),a) 

{{9n”,Tn),a) 


and it is not difficult to show that is the transformation that converts the 
filter measure at time n—l into the filter at time n, i.e., 7r„ = ’^ni'^n-i) [HE]. 
Composition of maps is denoted o o • • • o dts+i, for s < n, hence 

^'n|n-i(a) = and we adopt the convention = a. We also define 
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the functional r„|s : (ff —K) —>• (A” —>• K), recursively, as 


rn|n(M = h, 

^n\n—r{^) (^n— r+1 ^'n.|n— r+1 (^): r+l) 5 1; 


for s < n, and it is not difficult to show that [13] 


{^5 ^n|n—r(Q^)) 


{hn|n—r(^); 
(hn|n—r(f)i 


(2) 


where l(a::) = 1 is the constant unit function. 

For conciseness, we denote the set of bounded real functions over X as 
B{X), i.e., h G B{X) if, and only if, h is a map of the form A” —>■ K and 
||/i||oo = sup^g_^. \h{x)\ < oo. In the sequel, we analyze the asymptotics of 
the approximation errors \{h,Tr^) — (li,7r„)|, where h G B(X), subject to the 
following assumptions. 


Assumption 1. There exists a bounded sequence of positive real numbers {an}n>o 
such that < glf^{x) < an, for every x G X, and a = sup„>g a„ < oo. 

Assumption 2. For any probability measures Q.,rj G V{X) and every h G B{X), 


£{h,T) = sup\{h,'^/n+T\n{0!)) - {h,'i/n+T\n{v))\ < oo, and lim £’(/i,r) = 0. 
n>0 T-yoo 

Assumption [^states that the likelihood functions are upper-bounded as well 
as bounded away from 0. Assumption [^states that the optimal filter 7r„ for the 
given state-space system is stable. A detailed study of the stability properties 
of optimal filters for the class of state space models of interest here can be found 
in [13] (see also [22l|2T] for recent developments), including conditions on the 
kernels and the likelihoods which are sufficient to ensure stability. 


Assumption 3. The particle exchange step, with period uq, guarantees that 


E 


sup 

l<m<M 


< 


M<i- 


for every r S N 


(3) 


and some constants c < oo, 0 < e < 1 and q > A independent of M. 
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Intuitively, Assumption says that the aggregate weights remain “suffi¬ 
ciently balanced” (i.e., no PE takes too much weight compared to others). We 
also introduce the lemma below which, combined with Assumption is key to 
the analysis of the approximation errors, as it enables us to obtain tractable 
bounds for the aggregate weights. 


Lemma 1. Assume that 
E 


sup 

1<771<M 






< 


(4) 


M9-<= ’ 

for some q > 2, c > 0 and 0 < e < 1 constant w.r.t. M. Then, there exists a 
non-negative and a.s. finite random variable Uf, independent of M, such that 

n 


sup 

l<m<M 


’ ' n 


< 




(5) 


where < e < 1 is also a constant w.r.t. M. Moreover, there is another 
constant u^’'^ < oo independent of n and M such that sup„>Q E[{Ufr]<u^’T 

Proof. See Appendix A 


□ 


Remark 3. The r.v. can be written as 

OO 


M=1 


sup 

l<m<M 




(see Eq. (A.l) in Appendix A), where e<^<q — \is constant w.r.t. 
M. If we also note that the aggregate weights after the particle exchange step, 
can be computed deterministicall'^ given the aggregates before 
the exchange, then it follows that Uf is measurable w.r.t. the a- 

algebra Effi = Um>i , where each term in the countable union is a generated 
a -algebra, namely = a '-i 1 < m < M, 1 < j < . 

Finally, we introduce a simple inequality that will be repeatedly used through 
the analysis of Algorithm Let S V{X) be probability measures and 

let f,h£ B{X) be two real bounded functions on X such that {h, d) > 0 and 


^Because the map /3(m, k) used for the particle exchange is deterministic. 
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{h, /?) > 0. If the identities (/, a) = and (/, j3) = hold, then it 

is straightforward to show (see, e.g., [9]) that 

l(/,a) - (/,/3)l < \{fh,a) - (//i,^)| + \{h,a) - {h,P)\. (6) 

[n, a) ' ' [n, a) ' ' 

3.2. Uniform convergence over time 

In this section we rigorously prove that || (h, T^n^) ~ '^n) Up 0, as M —>• 

oo and K remains fixed, uniformly over time. The key result is Lemma|^below, 
on the propagation of errors across the map From this result, we then 
obtain the main theorem on the convergence of Algorithm 


Lemma 2 . Let K < oo be fixed. If Assumption [7] holds, with a < oo, and 
Assumption holds, with 0 < e < I and 9 > 4, then there exist constants 
< 00 and c < 00 , independent of M, such that 


\\{h,'Swn-k{7r^Jl))-(.h, 


8a*^+^u^c||/i||og, 


(7) 


for every h € B{X), k < n, p < q, and e € 5 j • 

Proof. Let us write tt^ = in the remaining of the proof for conciseness. 

We can use the relationship ([^ to rewrite the Lp norm of the approximation 
error {h,'Snin_k{T^^-k)) “ iK'^nin-k-ii'^^n-k-i)) as 

ll(h,4'„|„-/c(7r(^_fe)) - {K'i’nln-k-liT^n-k-lMp < 

^ i^u\n-kih),TT^_,,) _ (r„|„_fc(/t), 4'„_fc(7r(^_fc_i)) 

and applying ([^ together with Assumptionin the equation above, we readily 
find an upper bound of the form 


\\{h,'I/ri\n-k{T^n-k))-(.h,'i’n\n-k-l{Trn-k-l))\\p < [l|e^fe(^)llp + II oo || (1) ||p 

( 8 ) 


where 


eu,kW = i^n\n-k{h), T^n-k) “ {^u\n-k{h), n-k{T^n-k-l)) (9) 

(note that r„|„_fe(l) > a~^). 


12 












The two terms between square brackets on the right hand side (rhs) of (|^ 
have the same form. To upper-bound them, we need to find bounds for errors 
of the form IK?;, 7r^_j,) - {v, 'E'„_fc(7r^_j,_^))||p, where v S B{X). To do this, we 
first split the Lp norm of the error using a triangle inequality. 


To deduce a bound for the first term on the rhs of (10), let us recall that the 


particle exchange step does not modify the individual particle weights, only 
the aggregates, hence . Then, we can readily write the conditional 

expectation of - {v,Tr^_^)\P (given see Remark^ as 


E 




= E 


= E 


{v, - (v, 7r^_f,) f I 


n—k 


E 

m—l 


K 


E^i- 

i=i 


k 




n — k 


(U) 


where the r.v.’s = v{x^^’p) — (v,Tt^_f.) are conditionally independent 

(given zero mean (since = {v,TT^_f.)) and bounded 

(namely, ||^^™^^||oo < 2||z)||oo for all n, fc, m and j). Additionally, from step 
2.a) of Algorithm it follows that the normalized aggregate weights 
TO = 1,..., M, have the form 




(m) 

-fc 


l^i=iyn-k y-^n-k l“'n-fc-l 


1^1 = 1 1 ^ 1=1 Un-k y-Pn-k)'^n-k-l 




< 




— v^M 


E lvi 

/=1 l^i= 


W, 


n—k— 1 


a^W. 


(m) 


n—fc—1 


( 12 ) 

(13) 


where the inequality (12) is a consequence of Assumption]^ while (13) follows 
immediately from the definition of the weights in Algorithm However, given 


(13) and provided that there is no particle exchange at times n — k — l,n — 


k — 2,... (exchanges occur periodically with period no) we readily obtain a 
straightforward relationship in the sequence of aggregate weights, namely 




( 14 ) 
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Since the most recent particle exchange was carried out at most no time steps 
earlier, we can readily iterate (14) to obtain 


n—k — n—k—1 — — no\_{n—k)/noj 

However, the inequality (15) combined with Assumption yields 


(15) 


E 


T TT (TTTi) 

sup 


l<m<M 




J^P^n7lin-k)/noi 


< 


(o 2 "Oc)« 


Mi- 


(16) 


for some <? > 4, where c > 0, ng > 1 and 0 < e < 1 are constants independent of 
M, K and n. In turn, the inequality (16) enables the application of Lemma 
which states that there exists an a.s. hnite r.v. independent of M, such 

that 


TTr(fTl) ^ - fi—K, 

sup , 

:m<M ^ 


Ut 


-k 


l<m<M 


(17) 


where < e < ^ is also constant w.r.t. M. Substituting ( [T7| back into Eq. 
(EH) we arrive at 


E 


< E 


Tie T\/re ^ ^ 

MK ^ ^ 

m—1 j—^- 


\r: 


—k 


(18) 

Since U^_j^ is measurable w.r.t. (see Remark and the r.v.’s are 

conditionally independent, have zero mean and upper bound 2 ||u||oo, it is an 
exercise in combinatorics to show that 

(2C/-fcM-c||u||oo)^ 


E 


(u,<_,)-(z;,^)r_,)n^“. 


< 


(19) 


{MK)i 

for some constant c < oo independent of n, M and K (actually, independent 
of the distribution of the Taking unconditional expectations on both 


sides of the inequality in (|T9f yields 
E 


In, \ In, X|P / \ ! T (^Cl^H 

Et^n—k) \^i ^n—k)\ — Z/ J 




( 20 ) 


Moreover, 


where | —e> 5 — | >0 (see Lemma j^, since g > 4 in Assumptionj^ 
from Lemma there exists a constant < 00 such that sup„ yoEiiu^r] < 


14 

























u^’’^ < oo for some q > A. Therefore, for any p < q there exists such that 
sup„>o E < oo and 


E 


(r;,7r„_fc) - (u,7r„_fc) 


< 


u^’Pi2c\\v\\^)P 


which readily yields, for any v € B(A'), 


tk) - 


2u‘^d\\v\\ 


I ‘'n-kJ\\p ^ ’ 

M 2 2 


( 21 ) 


for any e S 5 ) j P ^ Q where u® = (u^’P)^ < 00 is constant w.r.t. 

M, K and n. 


We handle the second term in (10) by way of a similar argument. Let us 
define the u-algebra = Um>i ^n-k-i^ where each term in the countable 

union is a generated cr-algebra, namely 

= u 1 < m < M, l<j<K 

and recall that for every n (see Remark]^. For any v G B{X), we can 

decompose the integrals in the second term of ( [To| ) as follows. On one hand, for 
{v,'^n-k{T^n-k-i)) readily obtain 

E"., Ef., Bi»(Ci’)9r;E‘(4’-f 


(m)* 

- fc -1 


K 


/(O* 


e;=iE ti,_i]- ^ 


( 22 ) 


where = Em=i E^Li k ^ other hand, the integral 

{v,^n-k) similarly written as 


{v,T^n-k) = 


spM / (m.i), 1 /„_W (m.i), (mj)* 

l^m=l l^i=l ‘^y-Pn-k IPn-k \-^n-k l'"n-fe-l 


y„-k t-{s,i) ■. (s,i)* ’ 

Z^s=l l^i^lPn-k y-Pn-kl'^n-k-l 
where the weights are obtained after the exchange step. Since the map 

j3 used for the exchange is deterministic and one-to-one, we can readily compute 
(l,r) = j5~^{m,j) and, tracing back the particle exchange, we arrive at 


(m.j)* 


-(tr)* 
t'n-fc-l 


W. 


( 1 )* 


n—k— 1 

~K ' 
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As a consequence, it is possible to rewrite the integral {v,Tr^_f.) as 




(u,7r„_fc) = 


Vn-fc 

Z^s=l Z^i=l i/n-/c \^n-k )^^n-k-l 


( 23 ) 


Combining (22) and (23), and after some straightforward algebraic manipula¬ 
tions, the difference — {v,'^n-k{'^n-k-i)) can be rewritten as 

{v,Tt^_k)- {v,^n-k{T^n-k-l)) = 

X {i.V 9 l--k > in-k) - {E [vgt--^^ I J-“ fc_i] , eEfc)) 


r y^-k ^ 

yyn—k ’ ^n—k) 


+- 


X iigTSk^C-k) - [E [gT--k^\E^-k-i] ,in-k)) ■ 


\yn—k ’Sn—fc/ 

Resorting to Minkowski’s inequality, Assumption[2and the fact that all integrals 
are computed w.r.t. the same measure, CEfc> equality above easily yields 
the bound 


||(u,7rEfc) - (u,v|/„_fc(7rEfc-i))||p < a\\{vgl-k^ - ,CEfe)||^ 

+ a||u||oo II {gl->: - E [gl-^ ,_i] , e.;, 

However, the integral {vgl'Tk - E [vgll~k\E^_k-i] ,C-k) with v G B{X) re- 
duces to 


«r.- .e.) = E 


m—1 j — 1 

where, for all m G {1,..., M} and j G {1,..., K}, 


K 


'^n—k ’ 


(24) 


‘^n-k —^\^n-k )9n-k \^n-k > >9n-k \^n-k iKn-fc-lb 

are conditionally independent r.v.’s, with zero mean and bounded as | < 

2a||u||oo (recall that ||g)("||oo < a for every n, from Assumption [^ . Therefore, 
using exactly the same argument that led us from Eq. (0 to the inequality 
(21) (involving the use of Assumption]^ to upper-bound the aggregate weights) 


(A^^3) \„yn-k 


Ara,j) X y„_fc / (m,j) N I -r-oo 


now we arrive at 


E M2 2 


( 25 ) 
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for any < e < ^ and p < q, where c < oo, a < oo and < oo are constants 
w.r.t. M, K and n. 


Next, we substitute backwards to complete the proof. First, we insert (211 


and (25) into the triangle inequality (10), to obtain 




8a^u^c||^||oo 


(26) 


which yields a bound for error terms of the form in ([^, by simply taking v = 
^n\n-k{^)- Using this bound in we arrive at inequality 0 in the statement 
of Lemma [2] □ 


Theorem 1. Let K < oo be fixed. If Assumptions an and a hold, then the 
approximate measures eomputed via the DRNA algorithm converge uniformly 
over time in Lp. To be specific, 


lim sup||(/i,7r“^)-(/i,7r„)|| =0 (27) 

for any h G B{X) and every 1 < p < q, where q> 4 is given by Assumption^ 

Proof. Again, we write irff = for conciseness. The proof follows the same 
kind of argument as in m- Let us choose an arbitrary integer T > 1 and look 
into the error terms for n <T and n > T separately. For n < T, the difference 
{h, Trff) — (h, TTn) can be easily decomposed as 

C n — 1 

'^nln—ki'^n—k)) (^7 ^n|n—fc—1 ('^n—/c—1)) 

k^O 

+ (/l, «'„|o(7r^)) - (/l,^'n|o(7’'o)) 


hence we readily find an upper bound for the approximation error in Lp with a 
similar structure, namely 


\\{h,T^n) - {h,T^n)\\p < '^\\{h,'4! n\ri-k{T^n-k)) - n\n-k-l{'^n-k-l 




(/l,^'„|o(7r^)) - (/l,^'n|o(7ro))||p- 


(28) 
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For the second term on the right hand side (r.h.s.) of p8| ) we have 

(r„|o(/i),7r^) (r„|o(h),7ro) 


||(/i,«'„|o(7r^)) - (/i,^'„|o(7ro))||p = 


( 29 ) 


(r„|o(l),7r^) (r„|o(l),7ro) 

< a”||(r„|o(h),7ro^)-(r„|o(h),^o)||p (30) 

+«"l!/i||oo||(r„|o(l),7ro^) - (r„|o(l),7ro)||p, 

where the equality (291 follows from Eq. ([^ while (301 is a consequence of the 
inequality ^ together with Assumption Since it is straightforward to show 
that Tn\o{h) and r„|Q(l) are bounded, namely 


|r„|o(h)||oo < a" 


(hence ||r„|o(l)||oo < a”), 


and ttq is built with independent and identically distributed (i.i.d.) samples 
from TTg, we readily obtain the usual Monte Carlo bound for the approximation 
error of (h, ^'„|o(7r^)), i.e., 


lUL ,T, (h 'I' ("T All ^ C'ljhllooCt" ^ C'lj/lllooU^ 

||(/i,4'„|o(7ro )) (h,^'„|o(7ro))||p < 


(31) 


where C is a constant independent of M, K, p and n, and the second inequality 
holds because we are looking at the case n < T. 

The terms in the summation of ( |28[ ) can be upper-bounded using Lemma 
(note that the assumptions of Lemma are a subset of the assumptions in 
Theorem . Indeed, combining the inequality 0 and the bound in (|31|) into 


the original inequality (281 yields 


nJWp ^ 


< 


8 na”+iu''c||/i| 

8 ra^+iC||/i||, 


\\^^C\\h\\^a^ 


y/MK 


(32) 

(33) 


M^-^K2 

where C = max{u®c, C} and we have taken into account that there are at most 


T terms in the summation of (281 in order to obtain the second inequality. 


Similar to (28), for n > T we have 

T-l 


\\{h,Tr^) - (h,7r„)||p < ^ - {h,'i>n\n-k-l{'^n-k-l))\\l 


/c =0 


+ \\ih,'^n\n-T{'^n-T)) “ (^,|ra-r (tTw-t) ) ||p- (34) 


18 






















The remainder term on the rhs of (34) can be directly bounded by way of 
Assumption!^ namely 


||(h,4'„|„_T(7r^_T)) - {h,'i’t\n-Ti'^n-T))\\p < £{h,T), (35) 

where Vluit^oo £{h,T) = 0 for every h S B{X). The summation on the rhs of 


(34), on the other hand, has exactly the same structure as the summation in 


(28), hence the bound in (33) is still valid here and we can combine it with (35) 


and (34) to arrive al[^ 




(36) 


for n > T. Since the bound above is independent of n, and valid for arbitrary 


T, taking together (33) and (36) yields 




sup|l(/i,7r„ ) - (/i,7r„;||p - 
n>o 

Finally, for M sufficiently large, if we choose T = Tm and 


Tm = 


(i - £ - 7) log(M) - log(a) - log(8C||h||oo) 


1 + log a 


(37) 


(38) 


for any ye (O, | — e), then 

8Ta^+^C\\h\\, 


< 


M^Kh' 


(39) 


Since Utliim^ooTm = oo it follows that limM->.oo ^m) = 0 and, therefore. 


for N = MK, limM-i-oo sup„>o |i (h, tt" ) - {h, tt, 


nJWp 


= 0 . 


□ 


3.3. Convergence rates 

Theorem[l]provides a theoretical guarantee for the convergence of Algorithm 
[^when the number of PEs increases (even for a fixed number, K, of particles per 


^It is, indeed, important to realize at this point that the factor n in the numerator 
Sna^+^u^cll/illoo of the inequality | |32[ | arises exclusively from the number of terms in the 
summation of ( |28[ l, which is at most T, and not because of an actual dependence on time. 
Therefore, exactly the same argument is valid for the summation of ||34|l, even if n > T. 
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PE). However, it does not provide a convergence rate and, as a consequence, it 
is not possible to compare its performance with conventional (centralized) PFs, 
for which convergence rates are well known (see, e.g., Following an 

approach similar to m for the standard PF, we show in this section that it is 
possible to obtain an explicit convergence rate for Algorithmwhen the optimal 
filter is stable with a known rate itself. In particular, we adopt the following 
assumption, which entails the exponential stability of the optimal filter. 

Assumption 4. For any a^r] G V{X) and every h G B{X), there exist constants 
To < 00 and v > 0 such that 


sup|(/i,4'„+T|n(a)) - ^n+T|n(?7))| <exp{-i/T} for every T > Tq. 

n>0 

See [131 HH [3i] for a discussion of sufficient conditions for exponential sta¬ 
bility. Using Assumption]^ we can strengthen Theorem[2in order to obtain the 
following result. 


Theorem 2. Let K < oo be fixed. If Assumptions [7]^ hold, then for any 
h G B[X) and p < q 

sup||(fe, 7 r))^^)-(fe, 7 r„)|| < ^ (40) 

for some C < oo and C > 0 independent of M and K. In particular, 


f = min 


1 , 


V 

1 -b log(a) 


T, 


(41) 


for any T G \ h ~ ^ ^ <7^4 given by Assumption 

Remark 4. If Assumption^holds for arbitrarily large q then the inequality ( |40| ) 
holds for ( arbitrarily close to ^v, where the coefficient v = min|l, Yqri^(yy| 
depends on the state-space system. In this case. Algorithm^ matches the con- 
vergenee rate obtained for the standard PF with the same kind of analysis m- 
If Assumption holds only for some relatively small q > 4, then there is an 
actual loss in the eonvergence rate of Algorithm\^compared to a centralized PF. 
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Proof of Theorem Again, let us write for conciseness. We 


recall Eq. (37), reproduced below for convenience, 

9,Ta^+^C\\h\l 


sup ||(/i,7r^) - (/i,7r, 
ra >0 


n)\\p ^ 




(42) 


where e € 


/ £+1 1 
V 9 ’ 2 


M2-‘^K2 

and C < 00 is constant w.r.t. M and K. Since T < oo 


is arbitrary, we can T — Tm like in (38) which allows to upper-bound the first 
term on the right hand side of (|42|) using the inequality ([M| . As for the second 


term on the rhs of ( [4^ , Assumptionyields (for large M, so that Tm > To), 

C 


£{h,TM) < exp{-i/TM} < 


l + log{a) ( 2 T 


(43) 


wnere o - i-i-iog(a) 

Combining the inequalities (39) and (43) into (421 yields the inequality (401 
in Theoremj^ with T = \ - e -^ in (|4^. □ 


3 . 4 . Discussion 

In this section we have proved that Algorithm[l] based on the DRNA scheme 
of [S], converges asymptotically with the number of PEs, M, and uniformly over 
time. This is, to our best knowledge, the first rigorous proof of convergence for 
this type of PE, which has been used extensively in the literature [32 EH HI [13 
HIM]. Note that classical analyses, such as in IS Ho] HH HU E], do not hold 
for this algorithm because they do not take into account the distinct aggregate 
weights of the subsets of particles assigned to the PEs. 

Uniform convergence over time is relevant from a practical point of view. 
It implies that the DPF can run for an indefinitely long period of time, since 
the computational load (i.e., the number of particles) needed to guarantee a 
certain error bound (namely, the rhs of inequality @) is independent of the 
time index n. This should be compared with the classical convergence analyses 
in El or |33j . which are based on induction arguments and yield error bounds 
of the form Cn/^N, where N is the number of particles and Cn is a constant 
independent of N. It is simple to show [3| that lim„_>.oo Cn = 00 and, therefore, 
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the error bound diverges with time, i.e., lim„_>oo ^ = oo for any fixed N. 
Based on this type of analysis, the PF can only be guaranteed to work for a 
finite period of time. The advantage of uniform convergence, where the error 
bound is independent of time, comes at the expense of additional assumptions 
(Assumptions [T||^ in our case) which are not needed for the proofs of [3] or [33] . 

Assumptions [l] and are related to the stability of the optimal filter for 
the state-space model of interest. They refer to properties of the model, which 
may hold or not independently of the filtering algorithm we use. In practice, it 
is usually easy to show that they hold for models in which the state space X is 
compact. This kind of assumptions is common in the literature [nisniisi]. 

Assumption is similar to the regularity conditions imposed on the weights 
in [niiH]. We investigate its validity numerically, by way of computer simu¬ 
lations, in the example of Section]^ Intuitively, it implies that the aggregate 
weights of the PEs remain “balanced”, i.e., no PE is expected to accumulate 
all the weight -a situation that would lead to degeneracy of the distributed 
scheme, which would be reduced to a centralized PF with only K particles. 
Let us also point out that it is possible to monitor the aggregate weights online 
and possibly schedule additional exchange steps in order to guarantee, e.g., that 






< cst/M^~^ for every m. The latter inequality is much stronger than 
Assumption!^ yet has the advantage of being verifiable in practice. 

Theorem[^provides an explicit rate for the uniform convergence of Algorithm 
[2 This is relevant because it can be argued that Theorem alone does not 
guarantee a “practically acceptable” performance. In particular, even if (271 
holds, convergence may still be so slow that the filter cannot be used for any 
practical purpose. We foresee that it may be possible to improve the error rate 
in Theorem by using techniques borrowed from m, which relies on slightly 
stronger assumptions on the state space model and the algorithm. 
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4. Computer simulations 


4-1- State space model 


We have carried out computer simulations for a problem consisting in the 
tracking of a target that moves over a 2 -dimensional rectangular region, using 
a WSN consisting of J nodes that produce binary (0 or 1) outputs, depending 
on the distance between the target and the node. In the sequel we describe the 
state space model for this problem. 

The system state at time n is denoted Xn = [rri,u„]^ S where r„ S 
is the target position and S is the target velocity. The prior distribution 

has the form ro(dxo) = Tl)drQ xAf{vo]0, (T^Q/ 2 )duo, where TZ = [—20,20] x 

[— 10 , 10 ] is the rectangular region of interest, U{rQ;TZ) is the uniform pdf over 
TZ of the initial position, rg, and A/’(wo; 0, cr^ 9 / 2 ) is the Gaussian pdf of the 
initial velocity, Vq, which has zero mean and covariance function cr^ q/ 2 ; with 
I 2 the 2x2 identity matrix. The variance parameter is = 5 x 10“^ for all 
simulations. 

In order to apply either Algorithmj^or a centralized standard PF we need to 
describe how to produce random samples from the transition kernel T„(da;„|a;„_i) 
Given the state at time n — 1, let us introduce the auxiliary r.v. 


1 

1_ 


1 

1- 

1- 

S 

1_ 


1 

0 

-1 


ance matrix has the form (7^ = 


and the parameters 


where k is the duration of the discrete time steps in the model (i.e., the continu¬ 
ous time elapsed between two consecutive realizations of the system state), and 
rjn is a sequence of i.i.d. Gaussian r.v.’s with pdf Nlrjn] 0, C^), where the covari- 

{K^al + a1)l2 0 

0 alh 

Uy and Gy represent the variance of any unknown (random) acceleration effects 
and other direct random perturbations of the target position, respectively. We 
set K = 1 and tr^ = a1 = 10“^ for the simulations. We also introduce a se¬ 
quence of i.i.d. Gaussian r.v.’s n > 1, with the same distribution as the 
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initial velocity, i.e., A/'(w„; 0, ct„_o^ 2 )- Then, the state conditional on Xn-i 
can be generated as 


^n-i 


if e TZ, 


[?^n—l 7 ^n] , if f'n ^ ^5 

A sample realization of a target trajectory, during 100 discrete time steps, ac¬ 
cording to the described model can be seen in Figure [ATT] 

The WSN consists of J = 18 binary sensors. The j-th sensor position is 
denoted Sj G TZ and its output is yn{j) G {0,1}, hence the complete observation 
vector at time n is yn = [j/„(l),..., The sensors measure whether the 

target appears to lie within a threshold distance /x = 7 m of the sensor position, 
but the output is random. To be specific, the output ynij) conditional on 
Wfn — Sjll < /X is a Bernoulli r.v. with parameter pi, whereas y-nij) conditional 
on 11 — Sjll > pis Bernoulli with parameter pi. We refer to pi as the detection 

probability, and set pi = 0.9 for the simulations, while we set pi = 10“^ and we 
refer to it as the false alarm probability. 

The probability mass of the observations can be written using the general 
notation in Section 2.1 


9niyn{j)\Xn) = 


as gniyn\xn) = Ilj=i 9niynU)\xn), where 
PlVnij) + (1 -Pl)(l - yn{j)), if |k„ - SjW < p 


Piynij) + (1 -pi)(l - ynij)), if lk„ - ski > P 
which allows to compute any necessary importance weights. 


4-2. Numerical results 

We first assess the validity of Assumption which is key in the analysis 
of Section and then compare the performance of the DBF described by Al¬ 
gorithm with a standard (centralized) PF in terms of the absolute error of 
the position estimates. Note that Algorithm actually reduces to a standard 
(or bootstrap) PF if we simply set M = 1 and, therefore, discard the particle 
exchange step. 

In order to carry out a fair comparison of the DPF and the centralized PF, 
the total number of particles must coincide. In the sequel, we present simulation 
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results with several values of M, namely M G {8,16, 32, 64,128}, while the 
number of particles per PE is kept fixed, K = 256. For the centralized PF, the 
number of particles is set as N = MK, hence N G {8 x K, 16 x K, 32 x K, 64 x 
K, 128 X K}. Note that the number of sensors collecting data, J = 18, is kept 
fixed for all simulations, despite the variations in the number M of PEs. 

For each value of M it is necessary to describe how the PEs are intercon¬ 
nected in order to carry out the particle exchanges specified by Algorithm [l] 
These interconnections can be fully described by a simple graph, and hence we 
use the Havel-Hakimi algorithm |20] in order to generate them automatically for 
each M. The resulting graphs are such that every PE has exactly M/4 neigh¬ 
bors. The period of the exchange step is set to no = 10, and at every exchange 
step each PE interchanges [3.6Ar/MJ particles with every neighbor. Since each 
PE has M/4 neighbors, this amounts to approximately 90% of the particles in 
each PE being swapped with particles belonging to its neighbor^ The map¬ 
ping j3 that determines the particles to be exchanged is kept deterministic, but 
depends (in an obvious way) on the graph generated for each value of M. 

We numerically assess whether Assumption holds. The parameters in¬ 
volved are tentatively set to c = 4, <7 = 4 and e = 0.5. According to Assumption 
for an arbitrary number of PEs, M, these values should yield an upper bound 
on the expectation of the supremum of the aggregated weights of the form 


E 


sup 

l<m<M 


\Yim) 


< 


Mi- 


(44) 


after every exchange step (i.e., when n = rno, for r G N). 


In Figure A.2 an estimate of the expectation on the left-had side (Ihs) of 


(44), computed by averaging 150 independent simulations, is plotted for every 


time instant, n = rno < 10, 000, along with the upper bound on the rhs of (44) 


when M = 32. It is clear from the figure that the estimate of the expectation 


value of 90% was chosen here to ensure that the aggregated weights of the PEs can be 
properly balanced even when one of them is much higher than the rest, i.e., when the particles 
of a single PE capture most of the importance weight. This proportion can be decreased, e.g., 
by reducing the period no between exchange steps. 
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in (441 is well below the upper bound after every exchange step (but this is not 
necessarily the case at times steps n ^ rno, when exchange steps are not taken) 
Using the same set of 150 independent simulation runs, we have estimated 
the L 2 errors of the posterior mean of the state computed via the DPF algorithm 
(i.e., w.r.t. to the true value of the 

state signal a;„, for 1 < n < 10, 000. Figure [AT3| shows the results. It is apparent 
that the error remains stable (it does not drift up) for the complete period of 
10,000 time steps. Moreover, the performance is very close to the centralized 
PF with the same total number of particles, N = MK = 32 x 256, for which 


the approximation errors are also show in Figure A.3 (note that the difference 
between the errors for the DPF and the errors for the centralized PF is also 
plotted). 

We have carried out additional computer simulation trials with M = 8,16,32,64 
and 128 in order to verify whether the parameter set {c = 4, g = 4, e = 0.5} 
appears to be independent of M, as demanded by Assumption For each 
value of M, we have run 230 independent computer simulations with n = 

1,..., 3,000 time steps. Figure |A.4| depicts, for fixed n = lOOno = 1, 000 and 
M = 8, 16,32,64,128 the (estimated) expectation and upper bound that corre¬ 


spond, respectively, to the Ihs and the rhs of (44). It can be observed that the 
expectation decreases, along with the upper bound, as M increases. However, 


the ratio between the bound on the rhs of (44) and the expectation on the Ihs 


of (44) becomes larger as M is increased: for this set of simulations, it ranges 
from « 22 when M = 8 to « 1.25 x 10^ for M = 128. These numerical results 
strongly suggest that Assumption holds true for this particular example. 

Finally, we aim at evaluating the rate at which the L 2 errors in the ap¬ 
proximation of the posterior mean of the state converge with increasing M. To 
compute these errors, since the true posterior mean of the state, namely the 
integral Xn = J a:„7r„((ia;„), cannot be computed exactly, we have used the esti¬ 
mates provided by a centralized PF with N = MK = 128 x 256 = 2^® particles 
as a proxy for the actual Then, using the same set of 230 independent 
simulations as in Figure pV.4[ we have empirically estimated the L 2 errors for 
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M = 8,16,32,64,128 and n = 2,000, and plotted them in Figure A.5 To 
obtain an empirical convergence rate, we have used the obtained L 2 errors to 
fit an exponentially decreasing function of the form —where C and C are 

M<N^ 

constants. The result, using a least squares fit, is C « 11.8 and C ~ 0.44, which 
is close to the optimal Monte Carlo rate of M~ s. 


5. Conclusions 

We have introduced the first rigorous proof of convergence for a particle 
filter (PF) based on the popular distributed resampling with non-proportional 
allocation (DRNA) scheme of [S]. We have provided sufficient conditions for the 
uniform convergence of the resulting distributed PF over time. Explicit error 
rates in terms of the number of processing elements (PEs) and the number 
of particles per PE have been obtained. Uniform convergence guarantees that 
the distributed PF can be run for an arbitrarily long sequence of observations 
without requiring to increase the computational load over time. This kind of 
convergence is inherently stronger than the consistency proofs in classical papers 
such as m as well as in more recent contributions like El EH HI]. As for future 
work, we believe that some recently developed theoretical techniques [41] could 
be applied in order to relax some of the assumptions made for the analysis 
and/or to improve on the error rates found in this paper. 

In order to corroborate the validity of the analysis and to assess the prac¬ 
tical performance of the distributed algorithm, we have carried out computer 
simulations for an indoor target tracking problem. The assumptions on which 
our analysis relies are standard in the literature for centralized PFs m, except 
for Assumption H that is needed to handle the particle exchange scheme and 
is key to prove convergence, therefore we have deveoted most of the computer 
simulation study to show that it holds numerically. We have also compared 
the position estimation error attained by distributed PF of interest and a stan¬ 
dard (centralized) PF, and found that the two algorithms display a very similar 
performance. 
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Appendix A. Proof of Lemma 

Let us denote = supi<,„<^ for conciseness. We follow the same 
type of argument as in the proof of m Lemma 4.1]. Choose a constant 7 such 
that e < 7 < 9 — 1 and define 

00 

= Y, )A (A.l) 

M=1 

The random variable is obviously non-negative and, additionally, it can be 
shown that it has a finite mean, E\U2’‘^] < 00 . Indeed, from Eaton’s lemma 

00 00 

E [t/;)’®] < Y ^ (A. 2 ) 

M=1 M=1 

where the second inequality follows from Eq. Q in the statement of Lemma 
Since 7 — e > 0, it follows that < 00 , hence E[U2’'^] < 00 . 

We use the so-defined r.v. 11^'^ in order to determine the convergence rate 
of . Obviously, and solving for yields < 

If ■"^6 define e = and = (C/))’'^)«, then we obtain the inequality 
Since E\UY‘^] < 00 , it follows that E[{UY)Y\ < 00 , hence 
is a.s. finite. Also, we recall that 0 < e < 1 and e < 7 < g — 1, therefore 
< e < 1. 
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Finally, note that 


Emr)] = E[uz'^] < ^ 

M=1 


independently of n, as shown by (A.2), hence it is enough to choose = 


J2m=i ^ ^ < oo in order to complete the proof. □ 
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Figure A.l: Sample trajectory of the target during the first 100 time instants. 
The crosses mark the positions of the sensors, whereas the diamond indicates 
the starting point. Vertical and horizontal axes in meters. 
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Figure A.2: Evolution over time of the supremum of the aggregate weights (to 
the fourth power) for M = 32, averaged over 150 independent simulation runs, 
with constants c = 4, g = 4 and e = 0.5. For clarity of visualization, only the 
time steps for which an exchange of particles is performed (i.e., n = rno) are 
shown. 
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Figure A.3: Evolution over time of the L 2 errors (w.r.t. the true states) for the 
DPF with M — 32, averaged over 150 independent simulation runs. The same 
errors for the centralized PF are also plotted. It is seen how the approximation 
error stays stable for up to 10, 000 times steps, as predicted by the uniform 
convergence result of Theorem [Tj 
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Figure A.4: Evolution of the expected supremum of the aggregate weights (to 
the fourth power, with constants c = 4, g = 4 and e = 0.5) as a function of the 
number of PEs, M, for a fixed time instant n = rriQ = 1,000. The expectation 
is estimated from a set of 230 independent simulation runs for each value of M. 
The upper bound prescribed by Assumption [3| is plotted as a dashed line. 










number of PEs (M) 


Figure A.5: Approximate L 2 errors of the position estimates for the DPF for 
different values of M. An exponentially decreasing function whose parameters 
are htted by least squares using the empirical L 2 errors is also displayed. 








